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ABSTRACT 



The Pre-"raading Skills Pip^ram (PRS) was developed at the Wisconsin 
llesearch and Development Center for Cognitive Learning, Research on 
preraa4ing skills was conducted from 1966 to>1969. Hie developmental 
period, 1970 to 1974, included pilqting and field t^esting instructional 
materials, teachers' m£uiuals, assessment instruments, and. a management 
system. ^ . 

Durinig 1972-73, a study was designed and carried out to investi- 
gate achievement associated with PRS. Taking part in the study were 
kind^garten children from (1) classes whose teachers were using^ PRS 
for the first time, (2) clarsses whose teachers had' used PRS during 
the previous year, and (3) classes whose teachers were not using PRS; 
ajid first grade children who had not used PRS in kindergarten. 

The majpr result of the study was that kindergarten children who 
used PRS scored significantly higher (a » .01) on five p^ereading skills 
tests than children who did not use the program. The study also showed 
that there is a high percentage of retention -of^ mastery or nonmastery 
s4:atus between the eind of kindergarten and th^fb^ginning of first grade. 
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INTRODUCTION 



The Pre-reading Skills Program (PRS) , a complete kindergarten level 
program designed to prepare children for reading instruction, was devel- 
oped at the Wisconsin Research and Development Center for Cognitive Learn-' 
ing ov^r the period 1970-74, It is now produced comamercially by th6 
Encyclopaedia Britanriica Educational Corjxjtation and, ak of November 1974, 
wwas* being used in approximately 500 classrooms. This pdper reports studie 
done during 1972 and 1973 which investigated the ef f ectiveVj^ss of PRS in 
meeting its skill objectives, the retention of the prereading skills 
between kindergarten cuid fir^|: grade, and the mastery of prereading 
skills after the first year oi^ reading instruction. These investigations 
utilized a field test version of PRS and are part of a continuing program 
for the empirical validation of PRS and its materials. 



1 

12 




II 



PROGRAM DESCRIPTION AND HISTORY 
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The goals gf PRS are* (1) €o accustom children, to a reading environment 
so^h^t they feel' comfortable with reading instruction; ' (2) to ensure that 
children acquire .a positive attitude toward reading;^ and (3) to teach chil- 
d-run five specific prereadin^ skills — attending to letter order^ attending 
to letter orientation, attending to word detail, sound matching, and sound 
blinding'. These five , skills were, identified in earlier studies (Venezky & 
Chapman, 1970) as being prerequisites for success in beginning reading. 
The rationale behind PRS is that reading failure can be prevented, by ensur- 
ing that children have these experiences, attitudes, and skills before they 
begin formal reading instruction. / 

From 1966 to 1969 research was coj|iducted on prereading skills that were 
potentially relatiad to reading success, and on the development of letter- , * 
sound generalizations at thesj^rimary level ^ In an explora,tory and speculative 
, paper, Venezlcy, Calfee, and Chapman (1968) discussed relationships between 
reViing, initial reading l^roblems, and reading skill - components. That paper 
wasN^llowed by a more technical discussion of reading skills (Calfee & ^ 
Venezi^, 1968) , which analyzed the importance of the reading skills identified 
in contemporary reading .r^searbh and the assessment of reading skills by stand- 
ardized reading tests. \ & * * ^ 

Initial' studies of specific prereading skills were reported by Calfee, 
Chapman, anc^ Venezky (1970) . The major- results of this^ research were the 
isolation of certain skills tha-t related -both logically and statistically to 
beginning reading — such as letter-string matching and souhd matching — and 
the isolation of other skills that were fdund to have little or no relation 
to reading Success — auch as phonemic disc^rimination and articula-tion. 

■Concurrent with these studies on prereading skills, development of an 
instrument for assessing skill abilities was begun. Chapman • (1971a, 1971b) 
reported the early development, administration, and refinement of a battery 
of prereading skills, tests. Originally called the Wisconsin Basic Prereading 
Skili Test, this instrument became the basis for the set of ' qriterion- 
referenced tests that are used for skill assessment in the current program. ^ 
By 1970, sufficient evidence w^s accumulated to suggest ^that' not only is it 
possible to diagnose prereading skill deficiencies at the kindergarten' .level , 
^ but also that remedying these deficiencies in kindergarten could signifi- 
cantly reduce reading failure during the ifirst year of reading instructiph. 
Plans were therefore drafted to begin development of ar\ instructional program 
in prereading skills 1;hat would focus on basic visual and auditory skills. 
These plans culminated in a needs and specifications paper which outlined an 
|Lnstructional progr^ in prereading skills (Venezky & Chapman, 1970) . One 
^concern of that pa^r^was the selection of skills for the envisioned kinder- 
garten program. ^ A skill had to meet two criteria before it would be considered 
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for emphasis in the program. First, the skill had to have a direct, logical 
relationship to learning tq read or to the reading process; and second, . it 
had, to shSpw a high partial correlation with reading ^access. 

Dxxring tjhe fall of 1970, five prereading skills were Selected to be 
tadght in the program. These were skills that were not only logically related 
to learning to read, but also had been found lacking in a sufficient number 
of kindergarterf children to Warrant their inclusion in a program. The five 
skills that were selected in 1970 are the ones that form* the basis of the 
current program.. • ' : ' 

Various instructional activities to teach these visual and auditory 
skills were developed and tiMed out with groups of kindergarten children • 
during the fall of 1970. At the same time, the Wisconsin Basic Prereading 
Skill Test was revised and field testec^ on kindergarten children in^Madison, 
Wisconsin. On the basis of that testing, the battery was further revised, 
and another sample of responses was obtained in the winter of 1970. 

A teacher's manual was then prepared, containing activity descriptions, 
scheduling suggestions, and guidelines for assessment. This manual, together 
with the instrut^iioHal activities that had been developed, formed the proto- 
type of PRS. ' . 

From February to May of 1971 this prototype was used in three Madison 
kindergartens. ' A staff member from the Wisconsin Research and Development 
Center was present at each class session to sferve as an aide and to evaluate 
the activities. Children '3 skill learning was also evaluated by administer- 
ing the Wisconsin Basis Prereading Skills Test.* At the end of the semester, 
the prototypic program was evaluated both in terms of children's skill learn- 
ing and in terms of the teachers" response to the instructional activiti^fev^^ 
Results of the tryout, reported in Venezky, Chapman, Seegal, Kamm, and 
Leslie (197J.) , justified plans* to expand Jthe program to a full school year 
of instruction. \ 

During the, summer of 1971, a program to teach the five skills was com- 
pleted. The instrudtional procedures adopted were based on the R&D Center's 
niodel-of Individually Guided Education (IGE) , and featured a variety of 
instructional groupings, with emphasis on small group and individual activ- 
ities. The program included day-by«^ay sequences of instructional* activities 
to teach the five skills, materials for these activities, and a management 
system 'featuring edge-notched cards to help the teacher keep records of each 
child's -needs and progress. The program also included a teacher's handbook, 
a resource file containing activity descriptions, and a revised version of 
the Wisconsin Basic Prereading Skills Test. 

In the 1971-72 school year, 14 teachers in 10 Wisconsin and Illinois 
schools participated in a field test of the program. In total, there were 
23 kindergarten classes, including 545 children. The 10 sctiooX^ included 
both cdnventional schools and schools implementing the IGE system and, 
within these categories, both urban and nonurban settings. The test; . 

design provided 'for formal (summative) evaluation of the Pre-reading Skills 
Program in terms of children's learnihg of the five prereading skills, and 



*At this point the test was renamed from Wisconsin Basic Prereading Skill 

Test to Wisconsin Bas?ic Prereading Skills Test. 
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. for subjective (formative) evaluation in terms of usability and effectiveness 
of the program activities and materials. The formal evaluation was carried 
out by the R&D Center's evaluation section, v^ile informal evaluation was*^ 
done by the Pre-reading Skills Project staff. Schools Vere closely monitored 
to determine the effectiveness of each compopent of the program, and feedback 
sessions with teachers we;:^ held to review the various program activities and 
materials. • . 

T^e field test results, which were docy^^nted by Kamm,. Zajano, HuBbard, 
and'Pittelman (1973), confirmed that teachers could successfully implement an 
individualized program to teach prereading skills. It was therefore decided 
to retain the overall design of the Pre-reading Skills Program in the next 
versioa of the materials. The field test also indicated that some revisions 
were nebessciry to shorten fehe instructional program, to clarify activity 
descriptions,. an& to facilitate the use of the classroom management system. 
The Prereading Skills Test,* whiqh is the formal assessment instrument of the 
program, needed additional development , as did the inservice training to pre- 
pare teachers to ui?e the program; * 

A small scale field test of the revised Pre-reading Skills Program was 
held during the 197^-73 school year. This field test inclljded schools that 
had used the program during the 1971-72 school year as well as several addi- 

.tional schools. Two separate studies w^re conducted during this field test. 
One, a detailed investigation of the effectiveness of PRS in meeting its 
objectives ^nd of ^kill retention between kindergarten and first grade, is 
reported in the next chapter of this paper. The pther study investigated 
inservice techniques for helping teachers utilize PRS and also used class- 
room observation, and teacher- feedback sessions to obtain information about 
the revised materials and to determine whether any further revisions of the 
instructional program would be needed. The results of this field test, which 

A are reported by Kamm and Pittelman (1975) , indicated that the revisions made 

V-n the program were effective but that further refinements of selected 
inaterials were desirable. 

^ In 1973, the National Institute of Education approved plans for publi- 
cation, and a contract was signed between the Board of Regents of the Univer-^ 
sity of Wisconsin and Encyclopaedia Britannica Educational Corporation to 
publish the program under the name PRS. The prbgram was published in August 
197^, and was nationally available ^for the 1974-75 school year. 



*At this point the test was again renamed. 
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III 

EVALUATIONS 



RODUCTION ; / 

PRS, the Pre-reading Skills Program, is based on the hypothesis that * 
children who master the skills stressed by the program are ready for formal 
reading instruction. Analysis of how to validate this hypothesis exposed 
several hidden questions that had to be answered before the hypothesis could 
be investigated. Before describing the effects of PRS on children's prep- 
aration ^r reading, it first had to be determined whether kindergarten 
children *ould in fact master the skills. Also, it had to be ejscertained 
whether mastery could be attributed to the program, or to maturity, or 
whether children entered kindergarten with the skills, it was also neces- ' 
sary to know whether the skills were retained once they were learned. 

Some of these questions had ±>een investigated ^arly in the development 
of PRS because the* selection of^skills involved decisions about what needed 
to' be taught and what could be xaught. More formally, data from the 1971-72 
field test established first that kindergarten students who participated in 
the field test did not come tq school with mastery of the* five prereading 
skills, and second that a sxabstantial increase in the students' mastery of ♦ 
tla^ prereading skills occurred by the encj of the kindergarten year in the ' 
classes where PRS was used (Kamm et al., 1973). However, conclusions about 
the effectiveness of PRS cannot iae drawn from these dc^a alone, chiefly 
because no estimates of expected levels of skill mastery were obtained for 
students not using the program. In addition, although data were gathered 
on reading failure among pitogram students who had completed their first year 
of formal reading instruction, interpretation of these -data was limited by 
the groupings of the first grade classes. Some of the fil^st grade classes 
were mixed — they contained sbm^ children with program background and some 
with nonprogram background. Also, there was not enough information available"^ 
on whether first grade teachers changed their curricul'um scheduling to take 
advantage of the increased readiness for reading of the entering students. 
Finally, no investigation "had been made of the degree to which prereading 
skills mastered in kindergarten are retained until the next school year. 
The primary and the hidden questions dealing with the central hypothesis, for 
the program had not been sufficiently studied. 

•JTius a study was designed to investigate the following specific 
questions: 

1. V What effect does PRS have on skill mastery? 

2. What changes in skill mastery occur over the summer /between 
kindergarten and first grade? 

3. Are the PRS skills mastered by the end of the first year 
of reading instruction by children who did not have PRS 
in kindergarten? 
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The first question seems deceptively simple, in that it might be answered 
quite quickly by measuring skill mastery gains for PRS classroopis. How- 
ever, this approach would fail to separate natural or spontaneous gain 
^rom program-related gain* It is not easyj to determine exactly how to 
measure the effect in an unbiased manner; /this prob}.em is one of the cen- 
tral issues of evaluation studies. The traditional approach, which is to 
compare program with nonprogram groups, has a number of faults, ^the most impor- 
tant of which is the difficulty of defining in precise terms the nonprogram or ^ 
control group. To compare classrooms on the basis of the formal programs 
which the teachers claim to be implementing is .of little value, since most 
kindergarten-level instruction is' teachei>-ce.ptered and loosely structured, 
leaving considerable latitude for the teacher ^o deviate from the intentions 
of the program authors. In ^additiqn,- most kindergarten-level t programs are-^ 
not specific about activity seque^ncing or about skill mastery. In class- 
rooms which do not use published preredding programs teachers still tend to 
give ^rereading instruction, as, for example, in letter-name drills or 
rhyming activities. Unless lengthy (and" expensive) observation schemes are 
adopted, the amount of prerpading instruction given by a kindergarten teacher 
cannot be accurately estimated. 

Nevertheless, after alternatives to the control-grqup approach that 
could be executed in a single year were considered, a decision to employ 
the control-group approach was made, based upon the following factors: 

1. The specific activities of ^RS teachers are specified in the ^ 
program schedule and resource file catds. Techniques had al- 
ready been developed for determining how closely the teachers 

, followed the schedule and resource file cards and how much 
time they spent in PRS activities. 

2. Since the control groups were used primarily to estimate the 
natural or spontaneous growth in skill mastery during the 
kindergarten year, classes which did not emphasize prereading 
skills could be used, even without having precise estimates of 
th6 time spent and techniques used for prereading skill 
instruction. 

3. Major deviations from the conditions in 2 above would diminish 
the program effects, and hence the study would give a conserva- 
tive estimate of the efficiency of the program, rather than the 
positively biased one that is usually associated with control- 
group comparisons. » 

Rather than representing the case for natural or spontaneous growth of 
certain skills, the control groups in this study actually reflect varying 
(and undetermin/d) amouiits of direct instruction in these skills. Since the 
child's presence in a kinderg^ten may have a positive influence on his 
acquisition of h variety of specific skills, nonkindergarten children were 
not included in the study. Attempts to control or to assess directly the 
amount of prereading skill instruction in the control, classes were ruled out, 
either because they would have been excessively expensive or because they 
would have created an unnatural classroom situation. 

To reduce certain other biases inherent in control-group studies, two 
types of comparisons were made, one based on skill mastery as measured by 

^'17 
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PRS tests ^ and the other based on total scores obtained on a standard- 
ized ^reading readiness test. * • * 

^ The second question investigated, that, of . skill retention between 
kiAdergai;ten and. first grade^ requires comparisons of mastery levels before 
and after the summer vacation, and. i,s; for the most part, free of t^ie uncer- 
tainties that applied to .the othe^ questipn. 

The third qqestion, that of* mastery of prereading -skills' at the end of 
the first year of reading instruction*, touches on' an issue that is not 
explored in dep^ here, namely, how do we determine that the PRS skills are 
necessary and sufficient for learning to -read? A discussion of this issue is 
presented by Venezky 119"^) • .For the Ipresent we ar'e attempting to determine 
only if the skills which are considered essential ^for entering into reading 
instruction are in f^ct acquired by the end of the first year of. reading 
instruction. Admittedly, this is a weak test of necessairy and sufficient 
co^'ditions, but: it was the only one we were willing to undertake jasing the 
field test version of the program. 



PROCEDURE 

Several groups of children were identified for the study: kinderc,arten - 
children whose ^teachers were using th*^ program for the first time (Program I) ; 
kindergarten chil^iren whose teachers had used the program in the previous year 
in addition to the current year- and were therefore familiar with its goals 
and materials (Program II) ; Jfindergarteii children in classes that w6re not 
using the program and whose schools had been identified as being comparable 
tolthe Prograta I schools by the R & D Center's Evaluation Section (Control); 
and first grade children in Rrogram I and Control schools who had no kinder- 
garten experience in the program (Gxade 1)".\^ 

The tsffio program groups were dif fereriti^ecJ in ordfer to assess the effects 
of 'teacher experience or familiarity on children's achievement. The first ^ 
grade group was included primarily \;jo identify the levels of prereading skill 
mastery at the beginning and at the ^nd of the f4.rst year of formal reading 
instruction. ^ •* \ 

Both urban and nonurban schools were se'ifect^d for pisQgram I ai^d Control 
groups, to ensure that the sample of students included a wide range of experi- 
ence and ability. All of the- schools designated as Program II were in cities 
with populations of less than 200,000, 

The resulting sample included 43 classes.' The kindergarten group con- 
tained seven Program I classes (1^ children) , 12 Program II clasfees (199 
children) , and 14 Control classes (264 children) . Part of the imbalance 
among the kindergarten groups is because one of the Program I schools did 
not use PRS after completing the initial fall testing. Since the fall session 
hadr started, this school was not replaced; instead the classes were made part 
of the Control group. In the first: grade group, there were 10 classes com- 
prised of 257 children. 

Four children — two boys and two girls — were selected randomly from each 
kindergarten and first grade class for testing with the Prereading Skills 
Te^. Testing was done individually by Center personnel. The testing 
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schedule was designed to give both comparative and longitudinal data. 
Children from the three kindergarten poptilations were tested at the begin- 
ning and end of kindergarten^ in the, 1972-73 school year and also at the 
beginning of first grade the following, year. The children in the Control 
gfoup wei:e testfed additionally during the winter of thei^ kindergarten year* 
to ensure that they received the same exposure to ^the tests as the Program I 
and Program II children whose teaches' used the test as part of their in-* 
structional program. The first grade c^iildr^n were tested at the beginning 
and end of the 197-12-73 school year. Since thS blending test was 
revised when the study began, it was not* included in the first fall^r th^ 
winter testing sessions at either grade level. The Ciymer-Barrett Test of 
Reading Readiness was given to all the kindergarten children at the end of 
their kindergarten ye^r , Table 1 summaarizes the testing schedule as described 
above, presents the number of schools and children in each group and in the 
sample, ahd indicates the rates Nof attrition, 

table\i 

Number of Children Who Took the Prereading Skills Test 
in Each Group During the 1972-73 Longitudinal Study 







Fall 1972 


Winter 1972-73 

-» 


Spring 1973* 


Fall 1973* 


Program I 

4 schools 
7 classes 

1 164 chilOTen 


26 




22 


15 


Program II 

5 schools 
12 clS'^ST&is 
199 children 


48 




1 

36 ' 


27 


Control 

4 schools 
14 classes 
264 children 


56 


51 


46 


26 


Grade 1 


40 




37 





5 schools 
J?0 classes 
257 children 



♦Includes the Sound Blending Test, 
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RESULTS 1--EFFECTS OF PRS ON SKILL MASTERY ^ • , 

Each subject was classed as either a master or a nonmaster *on e^ch test, 
(Mastery required a minimum of 14 correct out of a total jiQ3sible score of ^ 
16,) . The resulting scores, which are sumnarized in Table 2, show that the 
Control group /wcis superior to the Program I groyp on three of the four fall 
tests and syperior to the Program ll gro^p'on twC" tests, By^e^end of kin- 
dergarten, however, tlje Control groiip wcis dr'amaMcally lower than' either 
progr^ group on all of the skills tested. . ' , . 



TABLE 2 

Percentages of l^ndergarteg^hlldren Mastering Each Skill 




V 

/ 




Letter 


Letter 


Word 


Soiind 


Sound 




N 


Order 


Orientation 


Detail 


Matching 


Blending 


Fall 1972 














Program I 


22 


5 


14 


9 


5 


* 


Program II. 


36 


17 


42 


8 


6 


* 


Control 


46 


13 


24 


? 


13 


* 


All Ss 


104 


11 


24 


8 


8 


* 


Winter 1972-73 














Control 


46 


22 


46 


24 


33 


, ) * ' 


Spring 1973 














Program I 


22 


91 


82 


55 


59 


55 


Program II 


36 


94 


94 


81 


86 


67 


Control 


46 


44 


64 


33 . 


31 


24 



*The Sound Blending test was not used in the fall or winter. 



To compare score distributions, frequency distributions were plotted of 
the number of subjects obtaining each possible score on each test. These are 
shown in Figures 1-8. Each test was composed of multiple choice items, with 
three alternatives per item. Henq^ the guessing rate would be between five 
and six correct. For the fall and winter test sessions, the scores tend to 
be normally distributed with little evidence of either bottom or ceiling 
eff^ts. 
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Figure 1. Frecjuency distributions of the number of children 
at each number of items correct — fall 1972, 
entire kindergarten group. 
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Figure 2. Frequency distributions of the number of children 
at each number of items correct — fall 1972, 
Program I group. 
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Figure 3. Frequency distributions of the number of children 
at each number of items correct — fall 1972, 
Prog^&m II grot^. 
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Figure 4. Frequency distributions of the number of children 
at each number of items correct — fall 1972* 
Control group. 
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Figure 5, Preqtiency distributions of the number of children 
at each nxjmber of items correct — winter 1972-73, 
Control group. 
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Flgiure 6, Frequency distributicais of the number of 'chil4ren 
at each n\jmber of items correct — spring 1973, 
Programr I group • 
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Figure 7. Frequency di^txibutions of t±ie number of children 
. at each niamber of 4. terns correct — spring 1973, 
Program II group. * V » ' 
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Figure 8. ^ Frequency distributions of the n\snber of chilcLcen 
at each number of items correct — spring 1973, 
Control group. 
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For the spring testing- session. Program I and Program II scores all 
clustered at the high end of the scale. Control group score distributions 
tended to flatten out in the spring, with a slight tendency toward bimodal 
distributions, especially for letter order and Ifetter orieptation. 

The combinations of skills that were mastered by children in both Pro- 
gram and Control groups are presented in Figures 9-16, Figure 12 indicates 
that, of the Control children who entered kindergarten with some of the 
skills, most (10 out of 14 or 71 percent) had mastered letter orientation. 
At the end of kindergarten (Figure 16) this is even more pronounced with 30 
out of 33 or 91 percent of the children who had mastered at least one skill 
mast^Sk^q letter orientation. The combination of letter order and letter 
orie^ption was the most frequently occurring combination; mastery was 
reached by two-thirds of the children in the^ spring 1973 Control group (Fig- 
ure 16) who mastered skills. Figures 10 and 11 indicate that most of the 
Program I and II children who entered kindergarten with at least one of these 
skills had mastered letter orien^tion. At the end of kindergarten, nearly ^ 
all of the children in the samples had mastered letter orientation and letter 
order (Figures 14 and 15) . Other year-end combinati6ns of Skills are not 
clecir, for different reasons; in the Program I sample, at least one-third, of 
the sample failed to master each of the other~ three skills, while in the 
Program II sample oVer half the ctfildren mastered all five skills. 

One of the principal questions of the study concerns the mastery levels 
of the prereading skills that may be expected froni the use of the Pre-reading 
Skills Program; that is, the effectiveness of PRS in de.veloping the skills in 
children^ Data from the Program I, Program II, and Control groups were used 
to investigate this question. 

Two initial problems had to be resolved when considering how to compare 
PRS users^^and nonusers: attrition from the three groups during the school 
year, which may have affected the samples differentially, and initial differ- 
^•ences between the groins, which prevented simple year-end comparisons between 
users and nonusers. 

The question about attrition was, in effect, whether the children who 
took part in the treatment adequately represented *the entire sample that had 
been identified at the beginnir^g of the year. Investigation of this involved 
cpfflpciring the fall 1972 data for the Program I, t^rogram II, and Control 
groups with the fall 1972 data for each respective subgroup. These compar- 
isons are presented in Table*3. Of the differences between the percentages 
of children in samples and subsamples who mastered each skill, none is 
greasier than 4 percent. * This suggests that each subsample adequately repre- 
sented its respective sample. Thus the groups of children who took part in 
thd study were representative of the original random samples, and attrition 
during the school year was not a confounding factor. 

The effectiveness of PRS was investigatied by comparing data from users 
and nonusers of the program after attempting to take into account the apparent 
initial differences in the fill 1972 data. Two kinds of comparisons were 
studied. The first was a comparison 6f the means of users against nonusers 
on the various parts of the skills test. Another kind of comparison, which 
considered the mastery-learning aspect of the skills test, looked at group 
means of the number of skills mastered for users against nonusers. i 
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Figxare 9. The number of children mastering each combination 

of prereading skills — fall 1972, enquire kindergarten 
groiip. 
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Figure 10. JThe number of children mastering each combination 
of prereading skills — fall 1972, Program I group. 
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Figure H. The number of children ma^ 
of preresuiing skills — fall 



ring each combination 
fl2. Program II group. 
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^J!igure 12. The nianber* of children mastering each combination 
of prereading skills — fall 1972, Qontrol group. 
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Figure 13. The number of children mastering each combination 

of prereading skills — winter 1972-73, Control group. 
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Figure 16. The number of children mastering each combination 
of prereading skills — spring 1973," Control group. 
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TABLE 3 

Percentages (Number) of Children in Eatire 
Sample and in Subsamples Mastering Skills in fall 1972 



Letter 
Order 



Letter 
Orientation 



Word 
Detail 



Sound 
Matching 



Program 


I 


Sample* 
{N'= 28) 


4 


(1) 


11 


(3) ' 


7 


(2) 


1 

4 


(1) 


Program 


I 


Subseunple** 
(N » 22) 


5 


(1) 


14 


(3) 


9 


(2) 


5 


(1) 


Program 


II 


Sample 
itHi « 48) 


17 


(8) 


38 


(18) 


10 


(5) 


8 


(4) 


Program 


II 


Sub sample 
(N = 36) 


17 


(6) 


42 


(15) 


8 


(3) 


6 


(2) 


.Control 




Sample 
(N = 56) 


11 


T 

(6) 


20 


(11) 


7 


(4) 


11 


(6) 


Control 




Subsample 


13 


(6) 


24 


(11) 


9 


(4) 


13 


(6) 



*Sample selected at the beginning of the school year. 
**Subs£unple of * which received all tests as Scheduled. 



Analysis of covariance procedures were used to make the comparisons. 
Regression analysis was used on the fall 1972 and spring 1973 scores to 
generate a predicted spring 1973 score for each child. Since the fall 1972 
testing did not include data for sound blending , the generated data con- 
sisted of predicted scores for the other four skills and a predicted score 
for the number of skills mastered. These predicted scores were used in an 
analysis of variance to look for differences between the means of the groups 
These analyses, reported in Tables 4-8, indicate in each case di^erences 
among the means that are significant for a = .01. 

A Scheffe procedure was used to test the statistical significance of 
contrasting the mean of the PRS users agaiast the nonusers. In each of 
these^ five tests, the contrast, also at a = .01, was statistically signifi- 
cant. The confidence intervals for these contrasts axe reported in Table 9. 
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, TABLE 4 

Analysis of Variance Table for Estimated 
Scores for Letter Order 



Source 



DF 



SS 



MS 



F 



Regression due tx> 
group effect 

Regression due to 
sex 

Regression due to 
interaction 

Regression 

Error 



2 
6 

97 



217.7000 

0.3693 

- 22.9400 
356.1000 
636.4000 



10B.9000 

0.3693 

11.4700 
59.3500 
6.5600 



16.5919 

0.0563 

1.7483 
9.0466 



Total 



103 



992.5000 



65.9100 



For a = .01, F(2,97) = 4.83 
F(l,97) = 6.91 



tABLE 5 

Analysis of Variance Table for Estimated 
Scores for Letter Orientation 



SoiCrce 




DF 


SS 


MS 




F 


Regression due 
group effect 


to 


2 


42.32 


21.160 




7.1787 


Regression due 
Bex 


to 


1 


1.013 


1.013 




0.3438 


Regression due 
interaction 


to 


2 


29.890 


14.940 




5.0705 


Regression 




6 


i07.000* 


17.840 




6.0518 


Error 




97 




285.900 


2.947 






Total 




103 


392.9 


20.78 


-V- 





For a = .01, f(2,97) = 4.83 
F(1^97) = 6.91 
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TABLI 6 



Analysis of Variance Table for Estimated 
Scores for Word DetaiT 





Source 


DF 


ss 


MS 


F 


^ . 

Regression due to 
group effect 


2 


97.490 


46.740 


11.0576 


Regression due to 
sex 


1 


1.072 


1.072 


.2433 


Regression due to 
interaction 


2 


16.370 (T 


8.186 


1.8570 


Regression 


6 


287.200 


47.870 


10.8605 


Error 


97 


427.600 


4.408 




Total 


.103 


714.800 






For a = .01, F(2,97) 
F(l,97) 


= 4.83 
= 6.91 

TABLE 


7 






Analysis of Variance Table for Estimated 
Scores for Sound Matching 






Source 


DF 


SS 


MS 


F 


Regression due to 
group effect 


2 


215.50000 


107.70000 


16.2027 , 


Regression due to 
sex 


1 


0.04731 


0.04731 


0.0071 


Regression due to 
interaction 


2 


^ 5.36600 


2.68300 


0.4035 


Regression 


6 


537.40000 


89.57000 


13.4692 


Error 


97 


645.00000 


6.65000 




Total 


103 

> 


1182.00000 


96.220000 





For a = .01, F(2,97) = 4.83 
F(l,97) = 6.91 
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TABLE 8 



Analysis of Variance Table for Estimated 
Scores for Number of Skills Mastered 



\ T ' ^ 

Source ^ DF 


. ^S 


MS 




F 


Regression due to 

group errecu ^ 

Regress ion due to 

sex 1 




0*7 n Ar\r\ 
I, 1 % /4UU 


23. 


5687 


0.2235 


0.2235 


0.1898 


Regression due to 

interaction 2 


1.1260 


0.5630 


0.4783 


Regression 6 


103.0000 


"17.1700 


14. 


5882 , . 


Error „ 97 


114.2000 


1.1770 






Total 103 


217.2000 


18.3500 






For a = .01, F(2',97) = 4.83 
:F(i;97) = 6.91 










TABLE 


9 








Means anti Standard Deviations of Estimated Dependent Variables 
and Confidence Intervals for Differences Between the Mean of 
Program I and Program II Against the Mean of the Control 

• -. : 


- 


Program I # Program 1\ 

Mean SD Mean SD 

o 


Control 

Mean SD 


Upper 
Limit 
of C.I.* 


Lower 
Limit 
of t.l.* 


Letter 

Order 14.82 1.003 15.16 


1.136 


12.17 1.320 


9.01 


2.63 


Letter 

Orientation 15.14 0.4160 15.47 


0.573 


13.94 X).935 


'4.73 


.43 


Wo^d 

Detail 13.41 1.3590 14.56 


1.020 


11.93 1.239 


6.34 


1.10 


Sound / 

Matching 13.64 1.4740^ 14.42 


i.5ir 


il.07 1.909 


9.02 


2.60' 


Number of 
Masteries 2.86" 0.4110 3 ..44 


0.668 


1.79 0.768 


4.18 


1.48 



ERIC 



*a = .01 
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To summarize the comparison of PRS users and nonusers, regression 
analysis was ufeed to estimate achievement scores that took into account 
initialNdif fe^nces between the Program I, Program II, and Control groups. 
An analysis variance On these predicted scores showed that the group 
means were different; a post hoc ^^mffe contrast indicated that scores of 
users were significantly great^er ti^^n scores of nonusers. 

With this statistically significant contrast, the means of the esti- 
mated dependent variables (reported in Table 9) can be interpreted. On 
parts of the skills test, ^ the' means for PRS users are very high; mastery 
level is reached in six of the eight cells, while the other two (word 
detail emd sound matching for Program I) .are close to mastery level. Cor- 
responding means for the Control group are also fairly high, with one — 
letter orientation— almost reaching mastery level. These high scores for 
both PRS .users and nonusers, along with the' result that the differences 
between the users and nonusers are statistically significant, may indicate 
that one effect of PRS is to raise the achievement level of children who 
would not develop the prereading skills on their own. ^ 

Another effect of PRS is suggested by, the other contrast, that of the 
number of skills mastered. On this criterion, the nonuser group mean was 
les^s than two skills mastered (out of the four skills that were considered) , 
while th6 mean for the users was over three skfllSsinastered. Developing 
several of the prereading skills seems to be an important effect of using 
the Pre-reading Skills Program. ® 

A second approach to the assessment of PRS effect^ on skill development 
was based on scores on a standardized reading reauiiness test. Four subtests of 
the Clymer-Barrett Prereading Battery, Form A, incliKiing visual and sound match- 
ing activities and upper- and lower-casfe alphabet recognition were selected: 
Recognition of Letters; Matching Words; Discrimination of Beginning Sounds 
in Words; and Discrimination of Ending Sounds in Words. The four subtests 
were given to all children in the participating kindergarten classes in 
spring 1973. 

^o^rends in ,the results were anticipated. Since letter naming is 
not a part df the Pre-reacjing Skills Program, but is a standard part of 
most kindergarten curricula, it was predicted that scores for PRS users 
would be lower than scores for children in the Control group. On the other 
hand, since visual and sound matching activities are emphasized in PRS, it 
was predicted that scores for PRS users would b^ higher than scores for non- 
users -on the other threes subtests. 

Taking the mean scores op the four parts of the prfereading test that 
had been given in the beginning of kindergarten (Table 2) and comparing them 
by analysis of variance revealed that the groups were not initially equiva- 
lent; the Program II group entered significantly higher than the Control 
group, and the Control group scores were significantly better than the Pro- 
gram I group (a = .01). With' this result, it was decided that contrasting 
the spring 1973 Clymer-Barrett scores of the Program I and Control groups 
would give a useful but conservative comparison between PRS users and non- 
users. 

The mean scores for tl^e Program I (N = 154) and Control (JJ = ^62) groups 
on each of the four Clymer-Barrett subtests are shown in Table 10. The two 
anticipated trends are apparent; on the subtests for letter recognition, the 
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TABLE 10 

Group Means on Clymer-Barrett Subtests 

I 

f 





* 


Program I 
(N = 154) 


Control 
(N = 262) 


Recognition of Letters 
(Max. = 35) 


27.28 


29.12 


Matching Words 
(Max. « 20) 


15.75 


13.90 


Discrimination of Beginning 
Sounds in Words 
j(Max. « 20) 


15.94 


13.40 


Discrimination of Ending 
Sounds in Words 
(Max. = 20) 


15.27 


4 

13.49 









Control group mean was higher than the Program I group mean, while on word 
matching, beginning sounds, and ending sounds, the Program I group was 
superior. An analysis of variance on these data, reported in Table 11, 
shows that these differences are statistically significant. These results 
indicate that the designed effects of PRS show up on a standardized instru- p 
ment for assessing reading readiness. 



41ESULTS 1 1 "SKILL RETENTION 

The data gathered in spring 1973 and fall 1973 on the Program I, Pro- 
gram II, and control samples were used tb investigate retention of mastery 
or nonmastery status of children during the summer between kindergarten and 
first grade. An* immediate question, due to the extensive attrition between 
the two testing periods (see Table 1) , deals with whether or not the fall 
1973 samples are similar to the 1972-73 s^^mpj.es. The procedui^e used to 
ascertain the degree of similarity is the same^ as the one used earlier, that 
is, identifying within each group a subgroup of the children tested in spring 
1973, that subgroup composed of the children' who were available for testing 
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TABLE n 

Analysis of Variance Table Comparing Program I 
and Control Groups on Subtests of Clymer-Barrett Battery 
(Subtests are Considered to be Independent) 





Source 


DF - 


MS 


F 


Recognition^^of Letters 
Error 


1 

414 


329.40 
72.42 


4.55 


Matching Words 
Error 


1 ^ 
414 


334.20 
31.05 


IC. 76 


Beginning Sounds 
Error 


1 

414 


624.80 
28.25 


22.12 


Ending ^Sounds 
Error 


1 

414 


. 305.20 
24.47 


12.47 



For a = .01, F(l,414) = 6.70 
For a = .05, F(l,414) = 3.86 




in fall 1973. A comparison of the spring 1973 percentages of each subgroup 
with the spring 1973 percentages of the corresponcli^g entire groiip would 
then show whether the children available for testing in fall 1973 adequately 
represented the original groups. ThesB percentages are presented in Table 12. 
In 12 xyf the 15 comparisons, the difference is 8 percent or less emd the re- 
maining three cases- do not differ by more than 15 percent. These very small 
differences suggest that the fall 1973 subsamples adequately represehted the 
original samples. 

One of the general questions regarding retention is whether or not there 
are 4ifferences between users and nontisers of PRS. If there are differences, 
this could indicate that the way a child acquires a skill affects its reten- 
tion. Percentages of children who retained their mastery or nonmastery statxis 
between^ the spring 1973 and fall 1973 testing are presented in Tables 13 and 14 

The triples of mastery retention percentages (Table 13) are very similau: 
for each skill ^and differences between the two prbgraun groups seem equivalent 
to differences between either program group and the Control grpup. The three 
visual skills especially show almost identical percentages. 
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TABLE 12 

Percentages of Children In Entire Sample 
and In Subsample Mastering Skills In Spring 1973 



• 


Letter 

O^er 

1 


Letter 
Orientation 


Word 
Detail 


Sound 
Matching 


Sound 
Blending 


Program I Sainple 

(N = 2Z) 


— ( — ~ 


82 


55 


59 


55 


Program I Subsample 
(N « 15) 


87 


80 , 


47 


&7 


53 


P^gram II Sample 
(N = 36) 


94 


94 

a 


81 


, 86 


67 


Program II Subsample 
(N - 27) 


93 


93 


70 


81 


59 

y 


Control Sample 
(N » 46) 


I 

44 


64 


33 


31 


24"' 


Control Subsample 
(N = 26) 


58 

1 ■ .. • 


69 


35 


46 


31 

^ =^-.rn 



In the nonmastexy retention percentages (Table 14) , the three groups are 
very similar on therv^o sound skills. Some of the dissimilarities on the 
visual skills, espeidially. letter order, may result from the small niamber of 
children who were/nonmasters in spring 1973. 

In conclusion, there do not appear to be large differences in retention 
across the three groups. Thus, mastery or nopmastery retention for a child 
between the yend of kindergarten emd the beginning of first grade does not 
seem related to whether or not the child used PRS during kindergarten. 

The yretention data were ailso analyzed to show percentages of groups that 
chcuiged/their mastery and nonmastery classifications between grades. These * 

^ages indicate the^ reliability of the Prereading Skills Test, if given at 
the ohd of kindergarten^ as a source of relevant information for instructional 
decisions at the beginning of first grade. 

The percentages of children who chcuiged their classification are presented 
Table 15. (Since the previous cuialyses did not indicate differences between 
le three groups, the groups were pooled in Table 15.) The portion of the group 
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that chemged clMsification ranges from 6 percent for letter orientation to 
29 percent for word detail • There was no clear preference for direction of 
changes I for two skills (letter order and sovind matching) changes to non- 
mastery prevailed over changes to mastery, while for the other three skills 
a l2u:ger percentage changed to mastery than to nonmastery. 



TABLE 15 

Percentages of Children Who Do and Who 
Do Not Retain Levels of Mastery and Nonmastery 

(Spring 1^73/Fall 1973) 





Mastery/ 
Mastery 


Nonmastery/ 
Nonmastery 


Percentage 
Retaining 
Statvis 


1- 

Mastery/ 
Nonmastery 


Nonmastery/ 
Mastery 


Percentage 
Changing 
Status 


Letter 
Order 


66 


18 


84 


12 


4 


16 


Letter 
Orientation 


79 


15 


$4 


2 


4 ^ 


6 


Word 
Det2d.l 


46 - 


25 


71 


6 


23 


29 


Sound' 
Matching 


53 


29 

■4 


82 

1 


> 

12 

S 


> 

6 


18 


Sound 
Blending 


40 


40 


80 


7 ' 


13 


20 



Another point about the reliability of the Prereading Skills Test can be 
observed in Tables 13 and 14. Thirty-five children changed classification 
from\nonmastery' to mastery and 26 changed from mastery to nonmastery. In both 
groups^, itore than one-third of the children had a. nonmastery score of 13, while 
, approximately another one- fourth of each group had a nonmastery st:ore of 12. » 
This suggests that the reliability of the test for making first grade instrud- 




reliability of the test for assessing mastery for an individual child and 
perhaps not so mUch with children's learning or forgetting of prereading 
skills. 

RESULTS IIIr-FIRST GRADE MASTERY 

The first grade sample, comprised of children who did not use PRS, 
showed fall 1972 percentages of mastery on the four skills assessed *that 
are uniformly half again as great as those of the kindergarten Control 
sample in spring 1973 (Table 16), The spring 1973 first grade data show 
extremely high percentages of mastery:' over 90 percent on letter order, 
letter orientation, word detail, and sound blending, and only slightly 
lower (84 percent) on sound matching. The mastery combinations are shown 
in Figures' 17 and 18. 'These data demonstrate that children who enter their 
first year of reading instruction without certain prereading skills gener-' 
ally acquire them by the end of the year. Since the mastery percentages 
were so high in the spring (an average of 98 percent for visual skills and 
88 percent for sound skills) , no attempt was made to relate skill mastery 
to reading ability. Furthermore, no data wer6 obtained on the difficulties 
that children who entered the year without specific prereading skills had 
^in learning to read. .The present data, therefore, are a weak test of the 
effect of prereading skills "on learning to read. If, for example, many 
children who were reading adequately at the end of the year showed low pre- 
reading skill mastery, then the necessity of the selected sKills for learn- 
ing to read would be highly suspect. 



TABLE 16 

Percentages of First Grade Children 
Mastering Each Skill 
(N = 37) 







Letter 
Order 


Letter 
Orientation 


Word 
Detail 


Sound 
Matching 


Soxind 
Blending 


Fall 1972 


68 


85 


50 ^ 


50 


* 


Spring 1973 


100 


97 


97 


84 


92 



*Souhd blending was not tested in the fall. 
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(Note: The small region in the center is to be 

taken as "outside" of the Word Detail, region.) 



Figiire 17* The number of children mastering 

each combination of prereading skills- 
fall 1972, Grade 1 group. 



no 

4^ 



42 



u 

i 

o 
u 



I 

I 



'IS 



I S 



o 


8 


m 




Bl 


H 
H 








1 


1 




o 

M 














(Note: The small region in the cente;: Is to be 

taken as "outside" of the Vf^d Detail region.) 



Figure 18. The nunber of children mastering 

each combination of prereading -skills^- 
spring 1973, Gride 1 group. > 
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CONCLUSIONS 



The major conclusions which can be drawn from this study are that (1) 
many children who enter kindergarten without certain prereadlng skills do 
not ac(|ulre these skills without overt instruction in th^; (2) the use of 
PBS ensures a high percentage of skill mastery by children who need instruc- 
tion in prereadlng skills; cuid C3) no matter how these gkills are obtained 
by the end of kindergarten, they tend not to be lost by the beginning of 
first grade. On the question of the necessity of these skills for lecirning 
to read, these studies show only that children who have had a year of 
reading instruction also show a high level of prereadlng skill mastery. 
Further studies are required to show any Qiore definitive relationship 
between prereadlng skills cind learning to read. 
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